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Abstract — For a measurement matrix in compressed sensing, 
its spark (or the smallest number of columns that are linearly 
dependent) is an important performance parameter. The matrix 
with spark greater than 2k guarantees the exact recovery of k- 
sparse signals under an Zo -optimization, and the one with large 
spark may perform well under approximate algorithms of the 
lo -optimization. Recently, Dimakis, Smarandache and Vontobel 
revealed the close relation between LDPC codes and compressed 
sensing and showed that good parity-check matrices for LDPC 
codes are also good measurement matrices for compressed 
sensing. By drawing methods and results from LDPC codes, we 
study the performance evaluation and constructions of binary 
measurement matrices in this paper. Two lower bounds of 
spark are obtained for general binary matrices, which improve 
the previously known results for real matrices in the binary 
case. Then, we propose two classes of deterministic binary 
measurement matrices based on finite geometry. Two further 
improved lower bounds of spark for the proposed matrices are 
given to show their relatively large sparks. Simulation results 
show that in many cases the proposed matrices perform better 
than Gaussian random matrices under the OMP algorithm. 

Index Terms — Compressed sensing (CS), measurement matrix, 
Zo-optimization, spark, binary matrix, finite geometry, LDPC 
codes, deterministic construction. 

I. Introduction 

Compressed sensing (CS) |0}[3) is an emerging sparse 
sampling theory which received a large amount of attention 
in the area of signal processing recently. Consider a fc-sparse 
signal x = (xi, X2, ■ ■ ■ , x n ) T £ M. n which has at most k 
nonzero entries. Let A £ u mxrl be a measurement matrix with 
m <C n and y = Ax be a measurement vector. Compressed 
sensing deals with recovering the original signal x from the 
measurement vector y by finding the sparsest solution to the 
undetermined linear system y = Ax, i.e., solving the the 
following lo-optimization problem 

min 1 1*| |o s.t. Ax =y, (1) 

where ||*||o = \{i : Xi ^ 0}| denotes the / -norm or (Ham- 
ming) weight of x. Unfortunately, it is well-known that the 
problem ([T]l is NP-hard in general (4). In compressed sensing, 
there are essentially two methods to deal with it. The first 
one pursues greedy algorithms for Zo-optimization, such as the 
orthogonal matching pursuit (OMP) (5) and its modifications 
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1 6-8 1 . The second method considers a convex relaxation of 
(TJ, or the li-optimization (basis pursuit) problem, as follows 

m 

min I |jc 1 1 1 s.t. Ax =y, (2) 

where ||*||i = Y^=i \ Xi \ denotes the Zi-norm of x. Note that 
the problem |2]i could be turned into a linear programming 
(LP) problem and thus tractable. 

The construction of measurement matrix A is one of the 
main concerns in compressed sensing. In order to select an 
appropriate matrix, we need some criteria. In their earlier 
and fundamental works, Donoho and Elad [9| introduced the 
concept of spark. The spark of a measurement matrix A, 
denoted by spark(A), is defined to be the smallest number 
of columns of A that are linearly dependent, i.e., 

spark(A) = min{||H'||o : w £ Nullsp^(A)}, (3) 

where 

Nullsp^(A) ={f6l": Aw = 0,w^ 0}. (4) 

Furthermore, [9| obtained several lower bounds of spark(A) 
and showed that if 

spark(A) > 2k, (5) 

then any fc-sparse signal x can be exactly recovered by the Iq- 
optimization ([TJ. In fact, we will see in the appendix that the 
condition <j5j is also necessary for both the Zo-optimization ([T]) 
and the Zi -optimization pi. Hence, the spark is an important 
performance parameter of the measurement matrix. Other 
useful criteria include the well-known restricted isometry 
property (RIP) [10] and the nullspace characterization |[T2l[T3l . 
Although most known constructions of measurement matrix 
rely on RIP, we will use spark instead in this paper since the 
spark is simpler and easier to deal with in some cases. 

Generally, there are two main kinds of constructing methods 
for measurement matrices: random constructions and deter- 
ministic constructions. Many random matrices, e.g., Fourier 
matrices (T|. Gaussian matrices, Rademacher matrices ATI . 
etc, have been verified to satisfy RIP with overwhelming 
probability. Although random matrices perform quite well 
on average, there is no guarantee that a specific realization 
works. Moreover, storing a random matrix may require lots 
of storage space. On the other hand, a deterministic matrix 
is often generated on the fly, and some properties, e.g., 
spark, girth and RIP, could be verified definitely. There are 
many works on deterministic constructions [ 14-23 1. Among 
these, constructions from coding theory [19-23] attract many 
attentions, e.g., Amini and Marvasti [20 1 used BCH codes to 
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construct binary, bipolar and ternary measurement matrices, 
and Li et al. ll23ll employed algebraic curves to generalize the 
constructions based on Reed-Solomon codes. In this paper, we 
usually use A to denote a real measurement matrix and H a 
binary measurement matrix. 

Recently, connections between LDPC codes 11241 and CS 
excite interest. Dimakis, Smarandache, and Vontobel lETTl 
pointed out that the LP decoding of LDPC codes is very 
similar to the LP reconstruction of CS, and further showed 
that parity-check matrices of good LDPC codes can be used 
as provably good measurement matrices under basis pursuit. 
LDPC codes are a class of linear block codes, each of which 
is defined by the nullspace over F2 = {0, 1} of a binary 
sparse m x n parity-check matrix H. Let I = {1,2, ... ,n} 
and J = {l,2,...,m} denote the sets of column indices 
and row indices of H, respectively. The Tanner graph Gh 
ll25l corresponding to H is a bipartite graph comprising of 
n variable nodes labeled by the elements of I, m check 
nodes labelled by the elements of J, and the edge set 
E C : i £ I,j e J}, where there is an edge G E 

if and only if = 1. The girth g of Gh, or briefly the girth 
of H, is defined as the minimum length of circles in Gh- 
Obviously, g is always an even number and g > 4. H is said 
to be (7, p)-regular if H has the uniform column weight 7 
and the uniform row weight p. The performance of an LDPC 
code under iterative/LP decoding over a binary erasure channel 
is completely determined by certain combinatorial structures, 
called stopping sets. A stopping set S of H is a subset of 
I such that the restriction of H to S, say H(S), doesn't 
contain a row of weight one. The smallest size of a nonempty 
stopping set, denoted by s(H), is called the stopping distance 
of H. Lu et al. Il22l verified that binary sparse measurement 
matrices constructed by the well-known PEG algorithm ll26ll 
significantly outperform Gaussian random matrices by a series 
of experiments. Similar to the situation in constructing LDPC 
codes, matrices with girth 6 or higher are preferred in the 
above two works CTl l22l . 

In this paper, we manage to establish more connections 
between LDPC codes and CS. Our main contributions focus 
on the following two aspects. 

• Lower bounding the spark of a binary measurement 
matrix H. As an important performance parameter for 
LDPC codes, the stopping distance s(H) plays a sim- 
ilar role that the spark does in CS. Firstly, we show 
that spark(H) > s(H), which again verifies the fact 
that good parity-check matrices are good measurement 
matrices. A special case of the lower bound is the 
binary corollary of the lower bound for real matrices in 
0. Then, a new general lower bound of spark(H) is 
obtained, which improved the previous one in most cases. 
Furthermore, for a class of binary matrices from finite 
geometry, we give two further improved lower bounds to 
show their relatively large spark. 

• Constructing binary measurement matrices with relatively 
large spark. LDPC codes based on finite geometry could 
be found in [27 , 28 1. With similar methods, two classes of 
deterministic constructions based on finite geometry are 
given, where the girth equals 4 or 6. The above lower 



bounds on spark ensure that the proposed matrices have 
relatively large spark. Simulation results show that the 
proposed matrices perform well and in many cases sig- 
nificantly better than the corresponding Gaussian random 
matrices under the OMP algorithm. Even in the case of 
girth 4, some proposed constructions still manifest good 
performance. Moreover, most of the proposed matrices 
could be put in either cyclic or quasi-cyclic form, and 
thus the hardware realization of sampling becomes easier 
and simpler. 

The rest of the paper is organized as follows. In Section [TT| we 
give a brief introduction to finite geometries and their parallel 
and quasi-cyclic structures, which result in the two classes of 



deterministic constructions naturally. Section III obtains our 
main results, or the two lower bounds of spark for general 
binary matrices and two further improved lower bounds for 
the proposed matrices from finite geometry. Simulation results 
and related remarks are given in Section [IV] Finally, Section 
[V] concludes the paper with some discussions. 

II. Binary Matrices from Finite Geometries 

Finite geometry was used to construct several classes of 
parity-check matrices of LDPC codes which manifest excellent 
performance under iterative decoding l27l ll28l . We will see in 
the later sections that most of these structured matrices are also 
good measurement matrices in the sense that they often have 
considerably large spark and may manifest better performance 
than the corresponding Gaussian random matrices under the 
OMP algorithm. In this section, we introduce some notations 
and results of finite geometry l28lll33l pp. 692-702]. 

Let ¥ q be a finite field of q elements and ¥ q be the r- 
dimensional vector space over ¥ q , where r > 2. Let EG{r, q) 
be the r-dimensional Euclidean geometry over ¥ q . EG{r,q) 
has q r points, which are vectors of ¥ q . The /i-flat in EG(r, q) 
is a /i-dimensional subspace of ¥ q or its coset. Let PG(r, q) 
be the r-dimensional projective geometry over ¥ q . PG(r, q) is 
defined in ¥ q +1 \ {0}. Two nonzero vectors p, p' G F^ +1 are 
said to be equivalent if there is A G ¥ q such that p = Ap'. It 
is well known that all equivalence classes of ¥ q +1 \ {0} form 
points of PG(r,q). PG(r,q) has (q r+1 - l)/{q - 1) points. 
The /i-flat in PG(r, q) is simply the set of equivalence classes 
contained in a (p, + 1) -dimensional subspace of F^ +1 . In this 
paper, in order to present a unified approach, we use FG(r, q) 
to denote either EG(r,q) or PG(r,q). A point is a 0-flat, a 
line is a 1-flat, and a (r — l)-flat is called a hyperplane. 

A. Incidence Matrix in Finite Geometry 

For < pi < H2 < t, there are A r (/i2,/ii) /ii-flats 
contained in a given /12-flat and A(p2> pi) /12-flats containing 
a given /ii-flat, where for EG(r, q) and PG(r, q) respectively 
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Let n — N(r,ni) and J = N{r,H2) be the numbers of [in- 
flate and /i2-fiats in FG(r,q) respectively. The //i-flats and 
//2-flats are indexed from 1 to n and 1 to J respectively. The 
incidence matrix H = (hji) of //2-flat over //i-flat is a binary 
J x n matrix, where hji — 1 for 1 < j < J and 1 < i < n if 
and only if the jth /i 2 -flat contains the ith /^-flat. The rows 
of H correspond to all the //2-flats in FG(r, q) and have the 
same weight N(fi2, Mi)- The columns of H correspond to all 
the //i-flats in FG(r,q) and have the same weight ^4(//2,//i). 
Hence, H is a (7, p)-regular matrix, where 



(9) 



The incidence matrix H or H T will be employed as mea- 
surement matrices and called respectively the type I or type II 
finite geometry measurement matrix. Moreover, by puncturing 
some rows or columns of H or H T , we could construct a 
large amount of measurement matrices with various sizes. To 
obtain submatrices of H or H T with better performance, the 
property of parallel structure in Euclidean Geometry are often 
employed as follows. 

B. Parallel Structure in Euclidean Geometry 

In this class of constructions, an important rule of punctur- 
ing the rows or columns of H or H T is to make the remained 
submatrix as regular as possible. A possible explanation may 
come from Theorem [2] in the next section. This rule can be 
applied since the Euclidean geometry has the parallel structure 
and all //2-flats (or /ii-flat) can be arranged by a suitable order. 

Since a projective geometry does not have the parallel 
structure, we concentrate on EG(r, q) only. Recall that a //-flat 
in EG(r, q) is a //-dimensional subspace of or its coset. 
A //-flat contains q^ points. Two //-flats are either disjoint or 
they intersect on a flat with dimension at most /x — 1. The \i- 
flats that correspond to the cosets of a //-dimensional subspace 
of W q (including the subspace itself) are said to be parallel to 
each other and form a parallel bundle. These parallel //-flats 
are disjoint and contain all the points of EG(r,q) with each 
point appearing once and only once. The number of parallel 
//-flats in a parallel bundle is q r ~^. 

There are totally J = NEG( r , A 1 2) A^-Aats which consist of 
K = J/q r ~^ 2 parallel bundles in EG(r,q). We index these 
parallel bundles from 1, 2, ... K . Consider the Jxn incidence 
matrix H of //2-flat over /zi-flat. All J rows of H could be 
divided into K bundles each of which contain q r ~ fJ * 2 rows, 
i.e., by suitable row arrangement, H could be written as 

( H X \ 

H 2 



H = 



(10) 



V H K J 



where Hi (1 < i < K) is a q r ~^ 2 x n submatrix of H and 
corresponds to the i-th parallel bundles of // 2 -flat. Clearly, the 
row weight of Hi remains unchanged and its column weight 
is 1 or 0. 



Similar to the ordering of rows, the columns of H can 
also be ordered according to the parallel bundles in EG(r, q). 
Hence, by deleting some row parallel bundles or column par- 
allel bundles from H, and transposing the obtained submatrix 
if needed, we could construct a large amount of measurement 
matrices with various sizes. These will be illustrated by several 
examples in Section IV. 

In this paper, we call H or H T the first class of binary mea- 
surement matrices from finite geometry, and their punctured 
versions the second class of binary measurement matrices from 
finite geometry. 

C. Quasi-cyclic Structure of Hyperplanes 

Apart from the parallel structure of Euclidean geometry, 
most of the incidence matrices in Euclidean geometry and 
projective geometry also have cyclic or quasi-cyclic structure 
ll28ll . This is accomplished by grouping the flats of two 
different dimensions of a finite geometry into cyclic classes. 
For a Euclidean geometry, only the flats not passing through 
the origin are used for matrix construction. Based on this 
grouping of rows and columns, the incidence matrix in finite 
geometry consists of square submatrices (or blocks), and each 
of these square submatrices is a circulant matrix in which 
each row is a cyclic shift of the row above it and the first 
row is the cyclic shift of the last row. Note that by puncturing 
the row blocks or column blocks of the incidence matrices, 
the remained submatrices are often as regular as possible. In 
other words, this skill is compatible with the parallel structure 
of Euclidean geometry. Hence, the sampling process with these 
measurement matrices is easy and can be achieved with linear 
shift registers. For detailed results and discussions, we refer 
the readers to (28] Appendix A]. 

III. Main Results 

The definition of spark was introduced by Donoho and Elad 
||9l to help to build a theory of sparse representation that 
later gave birth to compressed sensing. As we see from ([5j, 
spark of the measurement matrix can be used to guarantee the 
exact recovery of fc-sparse signals. As a result, while choosing 
measurement matrices, those with large sparks are prefered. 
However, the computation of spark is generally NP-hard 1 29 1 . 
In this section, we give several lower bounds of the spark for 
general binary matrices and the binary matrices constructed 
in section II by finite geometry. These theoretical results 
guarantee the good performance of the proposed measurement 
matrices under the OMP algorithm to some extent. 

A. Lower Bounds for General Binary Matrices 

Firstly, we give a relationship between the spark and stop- 
ping distance of a general binary matrix. 

For a real vector x £ K™, the support of x is defined by 
the set of non-zero positions, i.e., supp(x) = {i : Xi ^ 0}. 
Clearly, \supp(x)\ = ||jc||o- 

Traditionally, a easily computable property, coherence, of a 
matrix is used to bound its spark. For a matrix A e Jj mx ™ 
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with column vectors ai,d2, ■ ■ ■ ,a n , the coherence fi(A) [j]is 
defined by @: 

l(«i>«j)l 



//(A) = max 

l<i^j<n 



|«i||2||«j||2' 



(ID 



where (ai,aj) = afttj denotes the inner product of vectors. 
Furthermore, it is shown in [9 1 that 

spark(A) > 1+ — ~. (12) 
n(A) 

Note that this lower bound applies to general real matrices. 

For the general binary matrix H, the next theorem shows 
that the spark could be lower bounded by the stopping dis- 
tance. 

Theorem 1: Let H be a binary matrix. Then, for any w 6 
Nullsp'^(H), the support of w must be a stopping set of H. 
Moreover, 

spark(H) > s{H). (13) 

Proof: Assume the contrary that supp(w) is not a stop- 
ping set. By the definition of stopping set, there is one row 
of H containing only one '1' on supp(w). Then the inner 
product of w and this row will be nonzero, which contradicts 
with the fact that w £ Nullsp^(A). Hence, spark(A) > s(A) 
according to the definitions of stopping distance and spark. ■ 

Remark 1: Let H be the m x (2 m — 1) parity-check matrix 
of a binary [2 m — l,m] Hamming code l33l . which consists 
of all m-dimensional non-zero column vectors. It is easy to 
check that spark(H) = s(H) = 3, which implies that the 
lower bound (\3\ could be achieved. This lower bound verifies 
again the conclusion that good parity-check matrices are also 
good measurement matrices. 

In particular, consider a binary m x n matrix H. Suppose 
the minimum column weight of H is 7 > 0, and the maximum 
inner product of any two different columns of H is A > 0. By 
(jTTJ, we have 



A 

7' 



Thus the lower bound ( [12} from |9| implies 

7 

spark(H) > 1 + —. 

A 



(14) 



On the other hand, it was proved that s(H) > 1 + ? If30l [3T1 . 



Hence, the bound ( 14 1 is a natural corollary of Theorem [T] 

As a matter of fact, for the general binary matrix H, we 
often have a tighter lower bound of its spark. 

Theorem 2: Let H be a binary m x n matrix H. Suppose 
the minimum column weight of H is 7 > 0, and the maximum 
inner product of any two different columns of H is A > 0. 

ThCn 2 7 

spark(H) > 



A 



(15) 



Proof: For any w = (u>i, w 2 , ■ . . , w n ) T <E Nullsp^(H), 
we split the non-empty set supp(w) into two parts supp(w + ) 
and supp(w~), 

supp{w + ) = {i : Wi> 0}, (16) 
supp{w~) = {i : Wi < 0}. (17) 

'Throughout this paper, we exclude the situation that [i(A) = or the 
matrix A has a all-zero column. 



Without loss of generality, we assume that |st£pp(H , ^)| ^ 
\supp(w~)\. For fixed j E supp(w + ), by selecting the j-th 
column of H and all the columns in supp(w~) of H, we get 
a submatrix H(j). Since the column weight of H is at least 7, 
we could select 7 rows of H(j) to form a 7X (l + \supp(w~)\) 
submatrix of H, say H(-f,j), where the column corresponds 
to j is all 1 column. Now let's count the total number of l's 
of _ff(7,j) in two ways. 

• From the view of columns, since the maximum inner 
product of any two different columns of H is A, each 
of the columns of i?(7, j) corresponds to supp(w~) 
has at most A l's. So the total number is at most 
7 + \\supp(w~)\. 

• From the view of rows, we claim that there is at least 
two l's in each row of H(^,j), which implies the total 
number is at least 27 l's. The claim is shown as follows. 
Let h(j) be a row of H(j,j) and h = (hi, . . . , h n ) be 
its corresponding row in H. Note that hj = 1. Since 
w € Nullsp^(H), 

= Wihi = Wihi + 2J Wihi, 

i&suppiw) i£Lsupp(w+) i£supp(w~) 

which implies that 

— Wihi = Wihi > Wj > 0. 

i£supp(w~ ) i€ L supp{w Jr ) 

So there are at least one l's in {hi : i € supp(w~)} and 
h(j) has at least two l's. 

Therefore, 27 < 7 + \\supp(w~)\, which implies that 

\supp(w~)\ > j. Since \supp(w + )\ > \supp(w~)\ > Z, 



\supp(w)\ = \supp(w + ) \ + \supp(w )\ > 



A 



and the conclusion follows. ■ 
Remark 2: Note that the matrix in Theorem [2] has girth at 
least 6 if A = 1. When 7 > A, it is clear that the lower bound 

Pof Theorem [2] is tighter than ( p"4| ). Combining Theorem 
ith {5]), we have that any fc-sparse signal x can be exactly 
recovered by the l -optimization (jTji if A; < 

Remark 3: Consider a complete graph on 4 vertices. The 
incidence matrix is 



H = 



/ 1 1 1 \ 

10 110 

10 10 1 

\ 1 1 1 / 



Clearly, 7 = 2, A = 1 and the lower bound ( 15 1 is 4. Moreover, 
it is easy to check that (1, —1, 0, 0, — 1, 1) € Nullsp^(H) and 
{4, 5, 6} is a stopping set, which implies that spark(H) = 4 
and s(H) = 3. This result could be generalized to the complete 
graph on n nodes. Then spark and stopping distance are also 



4 and 3 respectively, which implies that the lower bound ( 15 1 
of Theorem [2] could be achieved and may be tighter than one 
in Theorem 
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B. Lower Bounds for Binary Matrices from Finite Geometry 

Clearly, the lower bound of Theorem [2] for general binary 
matrices applies to all ones constructed in Section II by Finite 
Geometry. In this subsection, we will show that for these 
structured matrices based on Finite Geometry, more tighter 
lower bound could be obtained. 

Let H be the J x n incidence matrix of /12-flats over /ii- 
flats in FG(r, q), where < [i\ < \i 2 < r, n = N(r, /ii) and 
J = A^r, /i 2 ). Recall that H or H T are called respectively 
the type-I or tyep-II finite geometry measurement matrix. The 
following lemma is needed to establish our results. 

Lemma 1: [32] Let < [i\ < /12 < r and 1 < I < 
A((J,2,fi>2 — 1)- Given any I different /xi-flats F\, F2, ■ ■ ■ , Ft 
in FG(r, q) and for any 1 < j < I, there exists one (/12 — 1)- 
flat F such that Fj C F and Fi % F for all i = 1, . . . , j — 
+ ..I. 

Theorem 3: Let r, fii, /x 2 be integers, < /ii < /i2 < r and 
H be the type-I finite geometry measurement matrix. Then 



spark(H) > 2A(fj, 2 ,n 2 - 1), 



(18) 



where 

A(M2,M2-1) = 
Proof: Let 



-IX2 + 1 _ I 



q-i 

U = A(/1 2 ,M2 - 1) 



and assume the contrary that 

spark(H) < 2u. 

Select a w — (wi, W2, ■ ■ ■ , w n ) T g Nullsp^(H) such that 
\supp(w)\ — spark(H). By ( [To] ) and ( fT7) ), we split the non- 
empty set supp(w) into two parts supp(w + ) and supp(w~), 
and assume \supp(w + )\ > \supp(w~)\ without loss of gener- 
ality. Thus by the assumption 

\supp(w~)\ < u or \supp(w~)\ < u— 1. 

For fixed j £ supp(w + ), by selecting j-th column of H and 
all the columns in supp(w~) of H, we get a submatrix H(j). 
The number of columns in H(j) is 1 + \supp{w~)\ and not 
greater than u. Let Fj and {Fi, i G supp(w~)} be the ^ti-flats 
corresponding to the columns of H(j). By Lemma [TJ there 
exists one (^2 — l)-flat F such that C F and Fi % F 
for all i G supp(H" _ ). There are exactly u /12-flats containing 
F. Note that among these /i 2 -flats, any two distinct /x 2 -flats 
have no other common points except those points in F (see 
[28 1). Hence, each of these u /12-flats contains the /ii-flat Fj 
and for any i £ supp(H ,_ ), there exist at most one of these u 
/12-flats containing the /ii-flat J^. In other words, there exist 
u rows in H (j) such that each of these rows has component 
1 at position j and for any i € sitppfw - ), there exists at most 
one row that has component 1 at position i. 

Let H(u,j) be the ux (1 + \supp(w~)\) submatrix of H(j) 
by choosing these rows, where the column corresponds to j 
is all 1 column. Now let's count the total number of l's of 
H(u,j) in two ways. The column corresponds to j has u l's 
while each of the other columns has at most one 1. Thus from 
the view of columns, the total number of l's in H(u,j) is at 



most u + \supp(w~)\. On the other hand, suppose x is the 
number of rows in H(u,j) with weight one. Then, there are 
u — x rows with weight at least two. Thus from the view of 
rows, the total number of l's in H (u, j) is at least x+2(u— x). 
Hence, x + 2(u — x) < u + \supp(w~)\, which implies that 
x > u — \supp(w~)\ > 1 by the assumption. In other words, 
H(j) contains a row with value 1 at the position corresponding 
to j and at other positions. Denote this row by h(j) and let 
h = (hi, . . . , h n ) be its corresponding row in H. Note that 
hj = 1 and hi = 0,i E supp(w~). Since w € Nullsp^(H), 



= Wihi = ^2 w ihi 



i£supp(w) 

E 



Wihi > Wj > 0, 



w^i 

i£supp(w~ ) 



which leads to a contradiction. Therefore, the assumption is 
wrong and the theorem follows by ■ 

Remark 4: Combining Theorem [3] with (Bl, we have that 
when the type-I finite geometry measurement matrix is used, 
any /c-sparse signal x can be exactly recovered by the l - 
optimization ([TJl if k < A(/i 2 ,/i2 — 1)- 

Remark 5: For the type-I finite geometry measurement ma- 
trix H, it is known that s(H) > 1 + A(fi 2 , fi 2 - 1) E2). Thus, 
by Theorem [JJ 



spark(H) > 1 + ,4(^2, /*2 - !)• 



(19) 



Obviously, H has uniform column weight 7 = A(fj,2> Ml)- The 
inner product of two different columns equals to the number 
of /i 2 -flats containing two fixed /ii-flats. It is easy to see that 
the maximum inner product is A = A(/i2,A t i + 1)- Thus, by 
Theorem |2j 



spark(H) > 

A(/i 2 ,/il + 1) 

It is easy to verity by that 

2A(fi 2 , f i 1 ) 



(20) 



^(^^l + 1; 

2(q r -^ - 1) 



> l + A(/x 2j /x 2 -l) 



> 1 



& q^- lll {q-2){q r -^ 



q-i 

1) 



q>0, 



where the last inequality always holds because of 1 < < 



fi 2 < r and q > 2. This implies that the lower bound (20 1 is 



strictly tighter than the lower bound ( Tl9] >. On the other hand, 
the lower bound (18 1 of Theorem [3] is tighter than the lower 
bound d20l. This is because 



2A(/x 2 ,M2-l) > 



24(^2, Mi) 
^(M2,Ml + 1) 



-P2- 



-1 



1 



> 



q' 



1 



«• {ft 



q-l q^~ 
_ l)( g M2-Mi 



Ml — 1 

- «) > 0. 



In other words, for 1 < /ii < /12 < r, the three lower bounds 
(|T8j, (|20j, ([19J satisfies 

2A(/x 2j /xi) 



2A(/i 2) /i 2 -l) > 



-4(M2,Mi 



>1 + A(/i 2 ,M2-1), (21) 
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where the inequality becomes an equality if and only if \ii = 

m + i. 

Similarly, for the type-II finite geometry measurement ma- 
trix, we obtain the following results. 

Lemma 2: [32| Let < /ii < /12 < r and 1 < I < 
N(fj,i + 1,/ii). Given any I different /i2-flats Fi, F2, ■ ■ ■ ,Fi 
in FG(r, q) and for any 1 < j < I, there exists one (/ti + 1)- 
flat F such that F C Fj and F % Fi for all i = 1, . . . ,j — 
l,j + l,...L 

Theorem 4: Let r, fix, [12 be integers, < /ii < /12 < r and 
H T be the type-II finite geometry measurement matrix. Then 



spark{H T ) > 2N{m + 



(22) 



where for Euclidean geometry (EG) and projective geometry 
(PG) respectively 

q m+i _ 1 



N PG (vi + l,Mi) 



9-1 ' 
qHx+2 _ j 



9-1 

Proof: Note that the columns of H T are rows of H. Let 

u = N(iix + 1,/xi) 
and assume the contrary that 

spark(H T ) < 2u. 

Select a w = (wi, W2, ■ ■ ■ , wj) T € Nullsp^(H T ) such that 
\supp(w)\ — spark(H T ). We split supp(w) into supp(w + ) 
and suppfw - ), and assume \supp(w + )\ > |supp(H"~)| with- 
out loss of generality. Thus 

\supp{w~)\ < u or \supp(w~)\ <u—l. 

For fixed j £ supp(w + ), by selecting j-th column of H T 
and all the columns in supp(w~) of H T , we get a submatrix 
H T (j). The number of columns in H (J) is 1 + \supp(w~)\ 
and not greater than u. Let Fj and {J^, i G supp(w~)} be the 
£i2-flats corresponding to the columns of H T (j). By Lemma[2] 
there exists one (/ii + l)-flat T such that T C and F %Ti 
for all z G sitppfw - ). There are exactly u /ii-flats contained 
in J 7 . Now, we claim that Fj contains these u /ii-flats and 
Fi (i € supp(>f~)) contains at most one /^-flat among these 
u n\ -flats. Otherwise, if Fi (i £ supp(w~)) contains at least 
two distinct \x\ -flats among these u /ii-flats, then Fi must 
contain F since F is the only (fix + l)-flat containing these 
two distinct /ii-flats. This contradicts to the fact that F is not 
contained in F t . Hence, there exist u rows in H T (j) such 
that each of these rows has component 1 at position j and 
for any i 6 supp(w~), there exists at most one row that has 
component 1 at position i. 

Using the same argument in the proof of Theorem[3] it leads 
to a contradiction. Therefore, the assumption is wrong and the 
theorem follows by ([6]) and Q. ■ 

Remark 6: Combining Theorem [4] with Q, we have that 
when the type-II finite geometry measurement matrix is used, 
any fc-sparse signal x can be exactly recovered by the Zo _ 
optimization ([T]i if k < N(pi + 1,/Zi). 



Remark 7: For the type-II finite geometry measurement 
matrix H T , it is known that s(H T ) > 1 + N(fii + 1,/ii) 
l32l . Thus, by Theorem [T[ 

spark{H T ) > l + 7V(/ii + 1,/^). (23) 

Obviously, H T has uniform column weight 7 = iV(/i2,/ii). 
The inner product of two different columns equals to the 
number of /ii-flats contained in two fixed /i 2 -flats at the same 
time. It is easy to see that the maximum inner product is 
A = 7V(/i2 — 1,/ii). Thus, by Theorem|2] 

spark{H ) > — r. (24) 

N{H2 - 1,/ii) 

Using the same argument in Remark Blwe have that for 1 < 
(j>x < (I2 < f, the three lower bounds (|22}, $2A) , ( [23| satisfies 

2^V(M2,Mi) 



2JV(^i + l,Aii)> 



> 1 + N(m + 1,mi), (25) 



^V(/i2-l,Ml) 

where the inequality becomes an equality if and only if /i2 = 
fix + 1 or Ml = f° r Euclidean geometry and /i 2 = Mi + 1 
for projective geometry, respectively. 

IV. Simulations and Analysis 

In this section, we will give some simulation results on 
the performances for the proposed two classes of binary 
measurement matrices from finite geometry. The theoretical 
results on the sparks of these matrices in last section could 
explain to some extent their good performance. Afterwards, we 
will show by examples how to employ the parallel structure of 
Euclidean geometry to construct measurement matrices with 
flexible parameters. 

All the simulations are performed under the same conditions 
as with 1 20 23 1. The upcoming figures show the percentage of 
perfect recovery ( SNR rec . > lOOdB ) when different sparsity 
orders are considered. For the generation of the fc-sparse input 
signals, we first select the support uniformly at random and 
then generate the corresponding values independently by the 
standard normal distribution Af(0, 1). The OMP algorithm 
is used to reconstruct the fc-sparse input signals from the 
compressed measurements and the results are averaged over 
5000 runs for each sparsity fc. For the Gaussian random matrix 
each entry is chosen Lid. from A/"(0, 1). The percentages of 
perfect recovery of both the proposed matrix (red line) and 
the corresponding Gaussian random matrix (blue line) with 
the same size are shown in figures for comparisons. 

A. Two Types of Incidence Matrices in Finite Geometry 

From Theorem [3] and Theorem |4j the two types of finite 
geometry measurement matrices have relatively large sparks 
and thus we expect them to perform well under the OMP. For 
the type-I finite geometry measurement matrix, we expect to 
recover at least (A(/j,2, fJ-2 — 1) — l)-sparse signals; while for 
the type-II finite geometry measurement matrix, we expect to 
recover at least (N(fXi + I, /ii) — l)-sparse signals. 

Example 1: Let r = 4,q = 2,/i 2 = 3 and /ii = 1. 
The EG{4,2) consists of J = 30 3-flats and n = 120 1- 
flats. Let H be the incidence matrix of 3-flat over 1 -flat in 
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5 10 15 

Sparsity Order: k 



Fig. 1. Perfect recovery percentages of a type-I Euclidean geometry mea- 
surement matrix in _EG(4, 2) with fi\ = 1, fi2 = 3 and the corresponding 
Gaussian random matrix. 




Sparsity Order: k 



Fig. 2. Perfect recovery percentages of a type-II projective geometry 
measurement matrix in PG(3, 2 2 ) with = 0, fj,? = 1 and the 
corresponding Gaussian random matrix. 




Sparsity Order: k 

Fig. 3. Perfect recovery percentages of a type-II finite geometry measurement 
matrix in EG(3, 7) with m = 0, /A2 — 1 and the corresponding Gaussian 
random matrix. The step size of k is 4. 




Sparsity Order: k 



Fig. 4. Perfect recovery percentages of a type-I finite geometry measurement 
matrix in EG(3, 2^) with fi\ = 1, fi2 = 2 and the corresponding Gaussian 
random matrix. The step size of k is 6. 



EG(A, 2). Then H is a 30 x 120 type-I Euclidean geometry 
measurement matrix. H has girth 4 and is (7, p)-regular, where 
7 = A EG (3, 1) = 7 and p = N EG (3,l) = 28. Moreover, 
spark(H) > 2Abg(3, 2) = 6 according to Theorem[3] From 
Fig. [T] it is easy to find that the performance of the proposed 
matrix is better than that of the Gaussian random matrix. In 
particular, for all signals with sparsity order k < Aeq(3, 2) = 

3 the recovery are perfect. This example shows that some girth 

4 matrices from finite geometry could also perform very well. 
Example 2: Let r — 3, q — 2 2 ,/i2 = 1 and n\ — 0. The 

PG(3, 2 2 ) consists of J = 357 lines and n — 85 points 
and H is the 357 x 85 incidence matrix of line over point 
in PG{3,2 2 ). Then H T is an 85 x 357 type-II projective 
geometry measurement matrix. H T has girth 6 and is (7, p)- 
regular, where 7 = Npc(l, 0) = 5 and p = Apc(l, 0) = 21. 



Moreover, spark(H T ) > 2N PG (1,Q) = 10 by Theorem 
It is observed from Fig. [2] that H T performs better than the 
Gaussian random matrix, and the sparsity order with exact 
recovery may exceed the one ensured by the proposed lower 
bound. For k < 10, exact recovery is obtained and the 
corresponding points are not plotted for clear comparisons, 
and the similar methods are used in the following figures. 

Example 3: Let r = 3, q = 7, /i2 = 1, and p,\ = 0. 
The EG(3,7) consists of J = 2793 lines and n = 343 
points, and H is the 2793 x 343 incidence matrix of line over 
point in EG(3, 7). Then H T is a type-II Euclidean geometry 
measurement matrix. H T has girth 6 and is (7, p) -regular, 
where 7 = iVB G (l,0) = 7 and p = A EG (1,0) = 57. 
Moreover, spark(H) > 2N EG (2,1) = 14 by Theorem g 
Note that the step size of sparsity order k is 4. 
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Fig. 5. Perfect recovery percentages of 4 submatrices of a type-I measurement 
matrix m EG(2, 2 4 ) with m = 0, /J, 2 = 1 and their corresponding Gaussian 
random matrices. The rows of the 4 submatrices from left to right are chosen 
according to the first 4, 5, 6 and 7 parallel bundles of lines in EG(2, 2 4 ), 
respectively. The step size of k is 2. 



Fig. 6. Perfect recovery percentages of 4 submatrices of a type-I measurement 
matrix in EG(2, 2 5 ) with fix = 0, pwi = 1 and their corresponding Gaussian 
random matrices. The rows of the 4 submatrices from left to right are chosen 
according to the first 6, 8, 10 and 12 parallel bundles of lines in EG(2, 2 5 ), 
respectively. The step size of k is 8. 



Example 4: Let r = 3, q = 2 3 , fi2 — 2, and [i\ = 1. 
The M?(3,2 3 ) consists of J = 584 2-flats and n = 4672 
1-flats. Let if be the 584 x 4672 incidence matrix of 2- 
flat over 1-flat in EG(3, 2 3 ). Then if is a type-I Euclidean 
geometry measurement matrix. if has girth 6 and is (7, p)- 
regular, where 7 = A BG (2, 1) = 9 and p = N EG (2, 1) = 72. 
Moreover, spark(H) > 2AegQ, 1) = 18 by Theorem|3] Fig. 
|4] shows that some matrices from finite geometry have very 
good performance for the moderate length of input signals 
(about 5000). 

B. Using Parallel Structure to Obtain Measurement Matrices 
with Flexible Sizes 

Parallel structure of Euclidean geometry is very useful to 
obtain various measurement matrices. Next, we show how to 
puncture rows or columns from the incidence matrix if or if T 
by several examples. 

Example 5: Let r — 2, q — 2 4 , ^2 = 1 and p\ — 0. The 
Euclidean plane EG(2, 2 4 ) consists of n = 256 points and 
J = 272 lines. Let if be the J x n incidence matrix. Since J 
is close to n, both if and H T are not suitable to be measure- 
ment matrices directly. However, according to the the parallel 
structure of if described in Section [TTJ all the 272 lines can be 
divided into 272/16 = 17 parallel bundles and each bundle 
consists of 16 lines. By if = (iff , iff, . . . , fff 7 ) T , 

where for i = 1, . . . , 17, Hi consists of the 16 lines in the 
i-th parallel bundle. By choosing the first 7 submatrices Hi, 
we get an m x n measurement matrix with uniform column 
weight 7. 

Fig. [5] shows the performance of the 64 x 256, 80 x 256, 
96 x 256, 112 x 256 submatrices of H which correspond to 
the first 4, 5, 6 and 7 parallel bundles of lines in EG(2, 2 4 ), 
respectively. From Fig. [5] we can see that all of the proposed 
submatrices perform better than their corresponding Gaussian 
random matrices, and the more parallel bundles are chosen, 



the better the submatrix performs, and its gain over the 
corresponding Gaussian random matrix becomes larger. 

Example 6: Let r — 2, q — 2 5 ,// 2 = 1 and p\ = 0. The 
Euclidean plane EG(2,2 5 ) consists of n — 1024 points and 
J = 1056 lines. Let H be the J x n incidence matrix. All 
the 1056 lines can be divided into 1056/32 = 33 parallel 



bundles and each bundle consists of 32 lines. By (10 1, H = 
(Hf , Hj , ■ ■ ■ , H^ 3 ) T , where Hi consists of the 32 lines in the 
i-th parallel bundle. By choosing the first 7 parallel bundles, 
we get an m x n measurement matrix with uniform column 
weight 7. Fig. [6] shows the performance of the 192 x 1024, 
256 x 1024, 320 x 1024, 384 x 1024 submatrices of H which 
correspond to the first 6, 8, 10 and 12 parallel bundles of lines 
in EG(2, 2 5 ), respectively. From Fig. [6] it is observed that 
all of the submatrices perform better than their corresponding 
Gaussian random matrices, and the more parallel bundles are 
chosen, the better the submatrix performs, and its gain over 
the corresponding Gaussian random matrix becomes larger. 

Example 7: Consider the 320 x 1024 submatrix in 
EG(2,2 5 ), say Hi,, in the last example. We will puncture its 
columns to obtain more measurement submatrices. Recall that 
H = {Hj , -ffj, . . . , H 33 ) T and the first 10 submatrices are 
chosen to obtain H), = (iff, if J, . . . , HJq) t . For the fixed 
submatrix ffn, its corresponding 32 lines are paralleled to 
each other and partition the geometry. Hence, when selecting 
the first j lines from ifu, the points on these j lines are 
different pairwise and the total number of points is 32j since 
each line contains 32 points. By deleting the 32j columns 
corresponding to these 32j points from iff,, we obtain a 
320 x (1024 — 32 j) submatrix, where is still regular. 

The 4 red lines from left to right in Fig. [7] show the 
performance of the 320 x 1024, 320 x 896, 320 x 768, 320 x 640 
submatrices of iff, which correspond that j = 0,4,8,12, 
respectively. It is observed that all of the submatrices perform 
better than their corresponding Gaussian random matrices (the 



9 



1 1 «89» 




120 130 140 

Sparsity Order: k 

Fig. 7. Perfect recovery percentages of 4 submatrices of Hf, and their 
corresponding Gaussian random matrices, where Ht, is the 320 X 1024 
submatrix of H in Example 6. The 4 submatrices (the red lines from left to 
right) are obtained by deleting 0, 128, 256, 384 columns of Hi,, respectively. 
The step size of k is 4. 



4 blue lines from left to right), but its gain becomes slightly 
smaller when more columns are deleted. 

V. Conclusions 

In this paper, by drawing methods and results from LDPC 
codes, we study the performance evaluation and deterministic 
constructions of binary measurement matrices. The spark 
criterion is used because its similarity to the stopping distance 
of an LDPC code and the fact that a matrix with large spark 
may perform well under the approximate algorithms of Iq- 
optimization, e.g., the well-known OMP algorithm. Lower 
bounds of spark were proposed for real matrices in (9J 
many years ago. When the real matrices are changed to 
binary matrices, better results may emerge. Firstly, two lower 
bounds of spark are obtained for general binary matrices, 
which improve the one derived from |9| in most cases. Then, 
we propose two classes of deterministic binary measurement 
matrices based on finite geometry. One class is the incidence 
matrix H of /i2-flat over /ii-flat in finite geometry FG{r,q) 
or its transpose H T , which are called respectively the type 
I or type II finite geometry measurement matrix. The other 
class is the submatrices of H or H T , especially those obtained 
by deleting row parallel bundles or column parallel bundles 
from H or H T in Euclidean geometry. In this way, we 
could construct a large amount of measurement matrices with 
various sizes. Moreover, most of the proposed matrices have 
cyclic or quasi-cyclic structure lEBl which make the hardware 
realization convenient and easy. For the type I or II finite 
geometry measurement matrix, two further improved lower 
bounds of spark are given to show their relatively large spark. 
Finally, a lots of simulations are done according standard 
and comparable procedures. The simulation results show that 
in many cases the proposed matrices perform better than 
Gaussian random matrices under the OMP algorithm. 



The future works may include giving more lower or upper 
bounds of sparks for general binary measurement matrices, 
determining the exact value of sparks for some classes of 
measurement matrices, and constructing more measurement 
matrices with large sparks. 

Appendix 
Proofs of Necessity 

For convenience and clear statement, we write the results 
to the following propositions. 

Proposition 1: For positive integer fc, any fc-sparse signal 
x can be exactly recovered by the ^-optimization ([TJ if and 
only if spark(A) > 2k. 

Proof: We only need to show the necessity. Clearly, 
the measurement matrix A does not have an all-0 column, 
which implies that spark(A) > 2. Assume the contrary that 
spark(A) < 2k. Select a w — {w% , . . . , w n ) € Nullsp^(A) 
such that ||w||o = spark(A). Let a = [spar k(A)/2\, where 
[■J is the floor function. Then 

1 < a < k, 1 < spark(A) — a < k. 

Let b be the a-th non-zero position of w and set 



x' = (wi, 
Let x = x' — w. Clearly, 



,w b ,0, ... ,0). 



11*11 o = spark(A) 



and Ibc'Ho < ||*||o- 



In other words, both x and x' are fc-sparse vectors, and x' may 
be sparser. However, since Aw — 0, we have that 

Ax' = Ax' - Aw = Ax, 

which implies that x can not be exactly recovered by the Iq- 
optimization ([TJ. This finishes the proof. ■ 
Proposition 2: For positive integer fc, any fc-sparse signal 
x can be exactly recovered by the l\ -optimization Q only if 
spark(A) > 2k. 

Proof: It is known (El El ED that any fc-sparse signal 
x can be exactly recovered by the ^-optimization Q if and 
only if A satisfies the so-called nullspace property, or for any 
w G Nullsp* R (A) and any K C {1, 2, . . . , n} with \K\ = fc, 



\wk\\i < \\wr\\i 



(26) 

< 2fc. By selecting 
such that ||w||o = 



where K = {1, 2, . . . ,n} \ K. 

Assume the contrary that spark(A) 
a w = (u>x, . . . ,w n ) £ Nullsp^(A) 
spark(A), it is easy to see that w does not satisfy (26 1 for some 
fc-subset K, e.g., letting K be the set of positions with the 
largest fc |wj|'s. This leads to a contradiction, which implies 
the conclusion. ■ 
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